SonART: A framework for data sonification, visualization and networked multimedia applications
نویسندگان
چکیده
SonART is a flexible, multi-purpose multimedia environment that allows for networked collaborative interaction with applications for art, science and industry. In this paper we describe the integration of image and audio that SonART enables. An arbitrary number of layered canvases, each with independent control of opacity, RGB values, etc., can transmit or receive data using Open Sound Control. Data from images can be used for synthesis or audio signal processing and vice versa. SonART provides an open ended framework for integration of powerful image and audio processing methds with a flexible network communications protocol. Applications include multimedia art, collaborative and interactive art and design, and scientific and diagnostic exploration of data.
منابع مشابه
A Flexible Framework for Real-Time Sonification with Sonart
We describe significant developments towards a real-time implementation of SonArt, the parameter mapping framework first presented in [1] . Enhancements include the incorporation of Open Sound Control (OSC) [2] which facilitates network communications, direct access to a variety of real-time synthesis software platforms, and distributed synthesis. The original goals for opensource, platform ind...
متن کاملApplication of Image Sonification Methods to Music
To utilize visual information for musical purpose, inevitable time-based nature of sound should be understood and considered. Time is the principle dimension within which all other auditory parameters are placed, and this poses a particular challenge to effective sonification of time independent images and their applications to music. In this paper we present two concepts of time mapping, scann...
متن کاملExploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience
The analysis of multimodal data comprised of images, videos and additional recordings, such as gaze trajectories, EEG, emotional states, and heart rate is presently only feasible with custom applications. Even exploring such data requires compilation of specific applications that suit a specific dataset only. This need for specific applications arises since all corresponding data are stored in ...
متن کاملM a S S I V E D a T a V I S U a L I Z a T I O N Data Sonification and Sound Visualization
Although most computational scientists routinely use visual imaging techniques to explore and analyze large data sets, they tend to be much less familiar with the use of sound. Yet sound signals carry significant amounts of information and can be used advantageously to increase the human/ computer interface’s bandwidth. The project described in this article focuses on scientific sonification—th...
متن کاملMultimedia Virtual Laboratory: Integration of Computer Simulation and Experiment
It is important that the researchers can examine the physical phenomenon by comparing the numerical simulation data and experimental results. In this research, the framework of the virtual laboratory in which the computer simulation data and the experiment data can be visualized together in the networked virtual environment was constructed. In order to represent the dynamic phenomenon, the mech...
متن کامل